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Abstract 

Fractal image compression techniques are now very popular for its high compression rates 
and resolution independence property. However, the qualities of decoded images of the 
existing techniques are not satisfactory. An adaptive partitioning scheme can improve the 
image quality significantly. These existing adaptive techniques use linear affine maps dur- 
ing encoding that have limited pixel intensity approximation ability. In order to increase the 
image quality further, non-linear affine maps can be used that generalizes the pixel intensity 
approximation and generates much better approximation. Here, a fractal based technique 
for image compression using non-linear contractive affine maps has been proposed that 
applies adaptive quadtree partitioning to partition image in a context dependent way to 
enhance decoded image quality. The technique partitions twice an image to be compressed 
to obtain collection of ranges and domains and finds the highest matching non-linear affine 
transformed domain of each range. The corresponding affine parameters are kept in the 
compressed file. However, a range may be broken into sub-ranges using adaptive quadtree 
partitioning for unavailability of enough matching domains and repeat the same on those. 
The comparative results show that the proposed technique greatly improves the decoded 
image quality than existing techniques and also maintains the high compression ratios. Two 
variants have also been proposed that improve compression ratio of the proposed technique 
without any degradation of image quality using loss-less coding. 


Keywords Fractal compression - Adaptive quadtree partition - Affine map - 
Non-linear affine map - Contractive transform - Compression ratio - Image quality 


1 Introduction 


Multimedia uses a combination of image, audio, text, video and animation and its secu- 
rity [19, 20, 49] becomes one of the interesting areas of research today. Again, the sizes 
of multimedia data are much larger than classical media tools. As a result, it takes huge 
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storage space and high bandwidth to transfer over the network. Therefore, size reduction 
of multimedia data is also very important. Moreover, image size deduction that is the basis 
of multimedia data also depicts its significance. The compression techniques [32] provide 
a good solution to these problems. Several techniques and standards already developed to 
reduce the image size of multimedia data. The compression techniques are lossless or lossy 
[32]. Mainly the lossy techniques are applied for image coding like DCT based JPEG [39] 
and DWT based wavelet [2, 7, 8, 35, 36] image coding. The DCT based JPEG coding is 
resolution dependent and is not efficient to produce good quality highly compressed image. 
Fractal image compression (FIC) [9] plays here a significant role since fractal compressed 
image does not depend on resolution and enlarged portions of image are free of blocky 
areas. The decoding time of the technique is very fast. The fractal coding represents image 
as a set of affine maps. However, the qualities of decoded images of the existing fractal 
compression techniques are not satisfactory. The most of the existing techniques use linear 
affine maps [9, 32] during encoding that have limited pixel intensity approximation ability. 
In order to increase the image quality further, non-linear affine maps (second order) [16] 
can be used that generalizes the pixel intensity approximation and generates much better 
approximation. However, the transformation should be contractive to use it in fractal com- 
pression. Zhao et al. [50] applied non-linear affine maps on fractal compression technique 
with quadtree partitioning (QP) scheme [9, 32]. The partitioning scheme of fractal compres- 
sion is an important factor to enhance reconstructed image quality. However, the QP does 
not depend on the pixels of the image block so that partitioned sub-blocks have matching 
portions. An adaptive quadtree partitioning (AQP) scheme [29] can be applied to solve this 
problem that splits image block in such a way that it enhance the possibility of finding self- 
matching portions. Therefore, a FIC technique has been proposed that applies non-linear 
affine maps and AQP scheme to enhance the quality of reconstructed image. The technique 
partitions an image to be compressed into a number of non-overlapping ranges and its dou- 
ble size overlapping domains and finds the highest matching non-linear affine transformed 
domain of each range. The corresponding affine parameters are kept in the compressed file. 
However, a range may be broken into sub-ranges using AQP for unavailability of enough 
matching domains and repeat the same on those. The decompression process takes the com- 
pressed file and a gray scale black image. It iterates affine transforms kept in the compressed 
file on the black image to reconstruct the decoded image. The related works are discussed in 
Section 2. The detail of non-linear affine map and it's contractive transformation property 
are well discussion in Section 3. The applied partitioning strategy is explained in Section 4. 
After that, a FIC using non-linear second order contractive affine maps and AQP scheme 
is proposed and discussed in detail in Section 5. Two variants of the same have also been 
proposed in section 6 that apply loss-less coding [27, 28] to enhance the compression ratio. 
Then, the experimental results are shown and analyzed in Section 7. Conclusion is made in 
Section 8. Finally, the references are given. 


2 Related work 


Barnsely and Hurd [3] first introduced the usage of IFS in image coding. The IFS based 
FIC technique was not applicable on natural images. After that Jacquin [14] presented par- 
titioned IFS for FIC that worked on natural images also. However, the technique suffered 
from huge encoding time. Several research works were continuing to enhance the perfor- 
mance of the technique. The image block classification strategy of fractal coding is one of 
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the main aspect of research to enhance performance. Fu and Zhu [10] proposed DCT based 
classification of image block to reduce the number of range-domain pair searching where 
Wang and Zhang [43] applied DWT for the same in fractal compression. Wang and Zheng 
[44] presented a FIC that classifies and sorts image blocks using correlation coefficients. 
Xing et al.[47] and Battacharayaet et al. [4] presented two different classification schemes 
for FIC that grouped domains in two level hierarchies to speed up the domain searching 
procedures. A different classification strategy for AQP based technique proposed by Nandi 
and Mandal [31] that also maintained two level hierarchies and then, Nandi [38] suggested 
an improved scheme for the same. Another aspect of research to enhance performance of 
fractal coding is partitioning scheme. Nandi and Mandal [29] suggested adaptive quadtree 
partitioning scheme where partitioning points were determined in such a way that increased 
the possibility of finding matching portions of images. Two HV partitioning based FIC [26] 
were also proposed by them to speed up the HV partitioning scheme. Nandi and Mandal [30] 
also applied adaptive quadtree partitioning scheme with archetype classification and per- 
formance was farther improved by using loss-less encoding. No-search fractal techniques 
are also suggested by Wang et al. [42] using fitting plane and Gupta et al. [11] in DCT 
domain. The Huber loss function, genetic algorithm, neural network and fuzzy logic were 
also applied to fractal coding. Jeng et al. [15, 24] introduced fractal coding using Huber 
loss function. Bobde et al. [6] used a variable genetype representation of IFS to improve 
fractal coding. Ai-Jawfi et al. [1] applied neural network methods on fractal encoding and 
Lakshmi [18] implemented a fractal image coding technique using neural network for MRI 
image also. Nodehi et al. [33] improved fractal method by using intelligent fuzzy approach 
that performed better than genetic algorithm based methods. Gupta et al. [12] made a com- 
parative analysis of edge based fractal coding for various frequency domains using nearest 
neighbor technique. The technique exercised FFT, DCT and real DCT on edge based fractal 
coding. Liu et al. [23] suggested a FIC for agricultural images and they [21] also presented 
a fast FIC using collected fundamental error. Liu et al. [22] applied distance grouping to 
make encoding more faster of FIC. Roy et al. [34] presented a fractal compression technique 
that calculated scaling parameters of affine maps with upper bound to reduce its complex- 
ity during encoding. All the techniques used linear affine maps at the time of encoding with 
limited pixel intensity approximation ability. To improve the image quality further, non- 
linear affine map has been used in proposed technique to generalize better the pixel intensity 
approximation. 


3 Non-linear affine map and its contractive transformation property 


The general form of affine map used in FIC techniques is in the form of (1) where (x, 
y) denotes the co-ordinate of a pixel to be mapped and z is the gray value. The terms 
a1, 42, 43, d4, £1 and gz are geometric parts. The function f(z) represents contrast factor. 
The affine map applied in most of the fractal compression techniques is only a special case 
of (1) where f(z) is obtained by using (2) and c and o represent scaling factor and brightness 
offset respectively. 


X aja, O0 X 81 
Y|-—|asa4 0 y|t+] go (1) 
Z 0 0 f(z) 1 0 

f(z) =cz +o (2) 
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Here, f(z) is linear and contractive mapping condition does not depend on the grey value 
of the domain pixels. Therefore, any arbitrary image can be used as the initial image during 
decoding process. But, its pixel intensity approximation is very limited and decoded image 
quality is poor. To reduce this problem, a non-linear affine map is used in the proposed tech- 
nique that is in the form of (3). It generalizes the pixel intensity approximation to provide a 
better approximation where f(z) is calculated by (4). 


X aja, O0 x 81 
Y|=/a3 a4 0 y|+ | ge (3) 
Z 0 0 f(z) 1 0 

[@= ciz? +azto (4) 


This affine map can be applied in FIC if it is contractive. Any affine map in the form of 
(3) is contractive if | f (z)| <h,0< h < lis satisfied and B A is contractive where 
f’ (z) is the first order derivative and | f (z)| is the absolute value of f'(z). In compression 
process, [n 1 scales down the size of domain block into as small size block as range 


and therefore, it is contractive most of the time. Now, if | T (z)| <h,0< h < 1 is satisfied, 
the affine map of (3) can be used in compression. Let us consider any two vectors pi = 
(x1, X2, X3), pi = (y1, y2, y3) and its corresponding affine transforms qı = (Xi, X2, X3), 
q = (Y1, Y2, Y3) respectively. Then, we have 


3 - Dı a, a2 0 di 
(à — q) = | D2 | = | a3 a4 0 dy (5) 
D3 0 0 f(x3) — fs) | Ld 
where Dj = X4 — Yi, D2 = X2 — Y2, D3 = X3 — Y3 and dı = x1 — yi, d2 = x2— y2, d3 = 


a2 


a , : : 
X3 — ya (say). As l à is set contractive, there exist a factor (say ^1) where 0 < h < 1 
3 a4 


that satisfy 


| Di + D < hiy di +d? (6) 


From Lagrange mean-value theorem, D3 = X3 — Ya = f'(x3) - — f'(y3) = f'(&)63 — 
ys) = f'E) 
(d3), £e (x3, y3). 


Therefore, | D3? = rl Ja? < hay di, 0< h «1 (7) 


Let us consider the maximum of factor A4 and A2 is max. Then, 


y Di? + D? + D3” < hmaxy di? + d? + d? (8) 


is satisfied and the affine map in the form of (3) is contractive. Now, it can be applied in 
FIC techniques and decoding process converges into a fixed image with in a finite number 
of iterations. 
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4 The adaptive quadtree partitioning (AQP) scheme 


In QP scheme [9, 32], partitioning of image block is context independent and does not share 
self-similar structures. Therefore, the quality of decoded image is not so good. This limi- 
tation is eliminated in AQP scheme [29] where splitting of the image is context dependent 
to share some self-similar structure. Let, a M x N range block holds the pixels Pi; for 
0 xk <M and0 x I < N, with left-top point (a, b) as depicted in Fig. la. 

In the first step of AQP, the range block is divided in horizontal direction. To do so, raw- 
wise pixel sum (Sx) is calculated for each pixel raw k, a < k < a + M — 1 using (9). 
Then, the absolute differences between k‘ and (k + 1)" row sum is computed for each 


b+N-1 b+N-1 
pixel rawk,a < k < a+ M — 1 as |S, — Spat l= $9 Phu- X Petia ||. Then, 
l=b l=b 


a linear biasing function MIN (k, M-k-1) is to compute the biased horizontal differences 
(H Dx) between k” and (k + 1)" row as given in (10). Next, a horizontal line k (say M p)is 
selected that maximize H Dx fora < k < a + M — 1. The horizontal line Mp splits range 
block into R; and R» as in Fig. 1b. 


b--N—1 
S= >) Pu (9) 
l=b 
(ab) | N | (a,b) | N | 
, (Mp-a) xN 
(Mp) We mee Ri 


(a) (b) 
(a,b) | (N1,-b) T (N-N1,+b) (ab) | (N1)-b) 7 (N-N1,+b) j 
Sub-range Sub-range Sub-range Sub-range 
(Mp-a) 8 8 (M,-a) 8 g 
Ra Ria Ri R13 


(2,5 (N28). 
(c) (d) 


Fig. 1 The Adaptive Quadtree Partitioning (AQP) scheme 
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AD, = MIN(kK,M—k-—1) ; (10) 


b+N-1 b+N-1 
( 2o Pu- >) Pon) 
Ib Ib 


for each pixel row k, a <k x a4- M — I. 
In second step, R is divided in vertical direction. The vertical pixel sum ($7) is calculated 


for each column 1, b < | < b+ N — 1 of R, using (11). Then, the absolute differences 
Mp-1 Mp-1 

between /’" and (I + 1) column sum i.e. S; — NIE Y Pu- YO Pki lis 
k=a k=a 


computed for each pixel column 1, b < | < b+ N — 1 and the liner biasing function MIN(I- 
b, N-1+b-1) is used to compute the biased differences as given in (12). After that, a vertical 
line 1 (say N 1p) is determined that maximize V D1; for b < 1 < b+ N — 1. The vertical 
line N1, splits R1 into R1; and A, as depicted in Fig. Ic. 


M,-1 
S= Pu (11) 
k=a 


Mp-1 Mp-1 
VDl; = MING —b,N-1+b-1|| Y, Pr- Y, Pemi |), (12) 
k=a k=a 


for each pixel row l, b <1<b+N-—1. 
In the last step, Ro is divided in vertical direction by similar way. The calculated absolute 


a+M-1 a+M-1 
value of successive differences is |( 95. Pkı— >> Pkı+ı| for each pixel column 1, 
I-M, I-M, 


b <l < b-N — l. and the biased difference is given in (13). After that, a vertical line 
1 (say N2,) is found that maximize V D2; for b < 1 < b+ N — 1. The vertical line N2, 
divides Rz into R21 and R22 as illustrated in Fig. 1d. 


a4-M—1 a+M-1 
VD2; = MIN( —b,N —1+b-—1)|( > Pei — > Pia. (13) 
I-My I-My 


for each pixel row l, b € | x b 4- N — 1. 

Finally, Mp x N1p Rit, Mp x (N — N15) Riz, (M — Mp) x N2, R21 and (M — 
Mp) x (N — N2,) R25 sub-ranges are created with left-top points (a,b), (a4N 15), (Mp,b) 
and (Mp, N2p) respectively. An example of the sheme is given in Section 4.1. 


4.1 Example of AQP scheme 


Consider an 8 x 8 image block (Fig. 2a). First, the pixel sum of eight rows are calculated 
as $,21580, $521580, $3=1700, $421660, $521610, S6=770, S7=805 and Sg= 810 respec- 
tively. The biased horizontal differences between successive rows 1&2, 2&3, 3&4, 4&5, 
5&6, 6&7 and 7&8 are calculated as min(0,7)|1580 — 1580/20, min(1,6)| 1580 — 1700|2120, 
min(2,5)]1700— 1660|280, min(3,4)]1660— 1610|2150, min(4,3)|1610—770|=2520, min(5, 
2) |770 — 805|=70 and min(6,1)|805 — 810|=5 respectively. The maximum difference is 
found between 5'" and 6" row. Therefore, the block is partitioned horizontally between 5" 
and 6!" row to form two sub-blocks R; and R5 (Fig. 2b). 


a Springer 


Multimedia Tools and Applications (2020) 79:26345-26368 26351 


220 220 230 190 200 190 170 160 220 220 230 190 200 190 170 160 
230 240 250 180 190 180 160 150 230 240 250 180 190 180 160 150 
220 240 240 200 200 210 200 190 Ri 220 240 240 200 200 210 200 190 
240 230 250 190 210 200 180 160 240 230 250 190 210 200 180 160 


200 230 210 180 200 210 200 180 


R2 
a b 
Ria @) R12 Ri ©) R12 
220 220 230 190 200 190 170 160 220 220 230 190 200 190 170 160 
230 240 250 180 190 180 160 150 230 240 250 180 190 180 160 150 
220 240 240 200 200 210 200 190 220 240 240 200 200 210 200 190 
240 230 250 190 210 200 180 160 240 230 250 190 210 200 180 160 
200 230 210 180 200 210 200 180 200 230 210 180 200 210 200 180 


R2 


R21 R22 
(c) (d) 


Fig.2 Example of AQP scheme a An image block of size 8 x 8 b After horizontal partitioning of the block 
into sub-blocks R, and R» c After vertical partitioning of R; into Rı.ı and R12 d After vertical partitioning 
of Ro into Ro. and R22 


After that, the calculation of vertical pixel sum of eight columns of sub-block R, are done 
as $(21110, 55-1160, 52-1180, $,—940, 52-1000, S¢=990, S5=910 and $,—840 respec- 
tively. The biased vertical differences between 1&2, 2&3, 3&4, 4&5, 5&6, 6&7 and 7&8 
columns are calculated as min(0,7)|1110 — 1160|20, min(1,6)]1160 — 1180|=20, min(2, 
5)|1180 — 940|2280, min(3,4)|940 — 1000|=180, min(4,3)]1000 — 990|=30, min(5,2)|990 — 
910|=160 and min(6,1) |910 — 840|=70 respectively. As a result, the sub-block A, is par- 
titioned vertically between 3'7 and 4" column to form two sub-blocks Rj,; and Rj» as 
shown in Fig. 2c since the maximum difference is found between 3'7 and 4^" column. 

Finally, the calculation of vertical pixel sum of of eight columns of sub-block R» are done 
as $1400, 57-440, 57-390, 5/410, 57-430, 57—90, $7—150 and 57—75 respectively. The 
biased vertical differences between successive columns are calculated as min(0,7)|400 — 
440|=0, min(1,6)|440—390|=50, min(2,5)|390—410|=40, min(3,4)|410—430|=60, min(4,3) 
|430 — 90|2990, min(5,2)|90 — 150|=120 and min(6,1)|150 — 75|=75 respectively. The 
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maximum difference is found between 5'^ and 6" column and the sub-block R» is divided 
vertically into two sub-blocks R2., and R22 between same as illustrated in Fig. 2d. 


5 The proposed technique 


The main features of the proposed technique are the use of non-linear affine maps instead of 
linear affine maps to produce better pixel intensity approximation and AQP instead of QP 
scheme to partition image in a context dependent way to enhance decoded image quality. 
The proposed technique is termed as FIC with AQP and non-linear affine maps (FIC-AQP- 
NAM). In case of linear affine map, finding optimum affine map requires minimization of 
the sum of squared error between range and mapped domain. The error value is calculated 
by using (14). The optimal values of the parameters c and o are obtained when the par- 
tial derivatives of E, w. r. t c and o are all zero as given in the following (15) and (16) 
respectively. 


=) {z - fe) =} Ue (14) 
i=1 i-l 
n = 29a- — o)z =0 (15) 
Fa- z —0)=0 (16) 


These equations are easily solved and the optimal parameters are obtained as given below: 
| In S(Zz) — S(Z)8(z)) 


{nS(z2) — S(z)°} 
o = {S(Z) — cS(z)) 


n n n 

where S(M) = Y; mi, S(MN) = } min; and S(MP N1) = Y: mj?nj?. However, the 
proposed ke applies a aa affine map instead of E affine map to produce 
better pixel intensity approximation. To find optimum affine map of the form of (3) from a 
range to domain, the sum of squared error between range and mapped domain is minimized 
here also. The error value is calculated by using (17). The optimal values of the parameters 
C1, C2, O are obtained when the partial derivatives of E» w.r.t c1, c2, o are all zero as given 
in the following (18), (19) and (20) respectively. 


-Yuz- fce -X (Zi — iz? — eaa — 0) (17) 
9 E» 7 Da 2 
Fr —2 2- (Zi — eizi^ — eozi — o)z^ —0 (18) 
BE; n 3 
TA E (Zi — cizi — eozi — 0)z; 20 (19) 
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dE : 
Pod es 23 (Zi — cizi? — coz; — 0) = 0 (20) 
i=l 


do = 


These equations are easily solved and the optimal parameters are obtained as 


¢ = BZ- SDS) + ASO? — SE} 
{S(z2)S(z) — S(z)7} 
(S(Zz)—S(Z)S@HS(22)" — S(z4)} — {$(Zz2)" — S(z2)S(ZHS(2)S@) — SEI) 
i (SEISE) — SN? — (SG) — SCIUS? — s) 
o0 = S(Z) — c2S(z) — as 


C2 


n n n 
where S(M) = mi, S(MN) = } mini and S(MP N1) = Y; mini. These cal- 
i=l i=l i=l 
culated parameters must satisfy the contractivity condition | f (zi)| = |c + 2c2z;| < 1 
ie. —1 < cy + 2c2z; < 1 where z; represents pixel value of affine transformed domain 
block AM;(DMN/;). It is very time consuming task to check every pixel of the block and 


therefore, its equivalent two (21) and (22) are used for the same as follows: 
—1<c,+2c2Zmax < 1 (21) 
—1<c,+2c2Zmin < 1 (22) 


where Zmax and Zin represent maximum and minimum pixel values of the block 
AM;(DMN/j) respectively. The next optimal parameters are computed sometime if opti- 
mal parameters do not satisfy the contractive condition. The optimal values of c1, c2 and 
o are floating point numbers that are quantized to ensure a compact encoding of the affine 
map. Instead of these three parameters, the position of domain (g1, 22) and information 
about rotation with flip operation types of the affine map AM, are quantized and stored in 
the compressed file. The affine map with quantized parameters is not the optimal map, but 
a better one. The details of compression and decompression algorithm of FIC-AQP-NAM 
technique are given in Sections 5.1 and 5.2 respectively. 


5.1 Compression algorithm 


The compression steps are stated in Algorithm 1. First, an image file (say IMG) and a toler- 
ance level QLTY (Image quality) is taken where lower QLTY means higher image quality. 
The minimum size (say MIN) of range block is assigned as 2 x 2. Next, the consecutive 
domain latency known as domain density (DD) is also assigned. Initially, the algorithm 
subtracts 128 from all pixels of the image IMG. Then, the whole image is partitioned into 
8 x 8 non-overlapping ranges (RNG;), 1 < i € NR (Number of ranges) that are marked 
as uncovered and a domain pool is created from input image by dividing input image into 
domain blocks where size of domains are at least double than range blocks to satisfy con- 
tractive transform property. These domains may overlap with each others. The domain pool 
is classified into 24 classes (CL ;) by using Fisher's classification [9, 32]. Now, for each 
uncovered range RN Gi, its corresponding class CLK; is found by the same way and a 
domain DM N; is selected from the class CL Ky only such that AM; covers best RNG, 
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than others i.e. that minimize RMS error DIF Fay s(RN Gy, AMy (DM Ny;)). If the param- 
eters c1, c? and o of AM, do not satisfy the contractivity condition, the next optimal 
parameters are computed. Again, if the RMS error is is below QLTY or it is MIN range 
block, then the parameters c1, c2 and o are quantized with other two parameters i.e. position 
of domain (g1, g2) and information of rotation with flip operation type of the affine map 
A My. In this way, if a domain is found for range Rx that is similar enough, the parameters 
of the AM, is kept to the compressed file and this range is marked as covered. Otherwise, 
the Rx is broken into four range blocks RNG,1, RNGi2, RN Gg3 and RNG;4 using AQP 
scheme and these belongs to uncovered range blocks. This process terminates when all 
range blocks are covered and the algorithm finally produces the compressed image I M Ge. 


Algorithm 1 The FIC-AQP-NAM compression algorithm. 


Require: A gray scale rectangular image (F) 


1: Input an image IMG. Set the tolerance level of quality and minimum range size as 
QLTY and MIN respectively. Set also domain density as DD. 
2: Subtract 128 from all pixels of the image IMG. 
3: Partition IMG into 8 x 8 ranges (RNG;), 1 < i < NR (Number of ranges) and 
these are labeled as uncovered. 
4: Create a domain pool maintaining domain density DD that may overlap each 
other. 
5: Classify all domains into 24 classes (CLS;,1 < i < 24) by using Fisher's 
classification. 
6: While (Range blocks RNG; exist that do not covered yet), do 
6.1: Find the class (CL Sx) of range (RN Gz) by using Fisher's classification and 
set CLS; Null. 
6.2:Search the domain DMN; from the class CLS, that has same class 
as RNG, and its corresponding non- linear affine map AM, that cover 
range RNG, wel than others ie. that minimize RMS error 
DIFFgyus(RNGy&, AM; (DM N;)). 
6.3:If (NOT (—1 < cy 4-2e2zmax < 1 AND —1 < c1 + 2c2Zmin < 1)), then 
Compute next optimal parameters c1, c2 and o. 
GOTO Step 5.3. 
End If; 
6.4: If ((DIF Frys(RNG x, AM; (DM N4)) < QLTY ) OR ( Size of RNG) < 
MIN ),then 
6.4.1: Quantize the parameters cj, c5, 0,position of domain (g1, g2) and 
information of rotation with flip operation type of the affine map A Mx. 
6.4.2: The parameters of the affine map AM, is written to the compressed file 
and RNG, is labeled as covered. 
6.4.3: Else, partition RNG, into four sub- blocks RNG,1, RNGjo, RNGia, 
RNG;4 using AQP scheme and label these as uncovered. 
End if; 
End while; 
7: The fractal compressed image file is produced containing a list of affine maps. (say 
IMGc). 
8: Stop. 
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5.2 Decompression algorithm 


The steps of FIC-AQP-NAM decompression algorithm are given in Algorithm 2. Initially, 
take an FIC-AQP-NAM compressed file I'M Gc. The number of iteration (i.e. number of 
time affine maps will be applied) is set as J, and scale factor (say Sf) scales the image by 
a factor of Sy. After that, the compressed image size (size, x sizey) is read and domain 
density DD is also taken from the input file. Next, the desired reconstructed image size is 
calculated by (23) and (24). 


dsizey = S x size, (23) 


dsizey = S x sizey (24) 


In the next step, the FIC-AQP-NAM decompression algorithm initializes the domain infor- 
mation similar with compression process and takes a dsize, x dsizey black image (I M Gp). 
Here, any arbitrary image cannot be taken as the initial image during decoding process. 
Because, the non-linear affine map has second order term and the contractive condition of 
each transform depends on the gray values of domains. This limitation can be overcome by 
adjusting gray values of image after each iteration such that gray values remain within -128 
and 127 that is for each pixel value z; of the image IM Gg, if zi < —128, set z; = -128 
and if z; > 127, set z; = 127. Then, the decoder reads all affine maps of IM Gc. Now, 
all these affine maps of IM Gc are applied over I M Gp iteratively and a completely new 
image is produced. This produced image now acts as IM Gpr for the next iteration. This is 
repeated J, times and produces a dsizex x dsizey I M Gg as decompressed image. Finally, 
the algorithm smoothes the transition between adjacent boundaries of ranges of IM Gg by 
pixel averaging. 


Algorithm 2 TheFIC-AQP-NAM decompression algorithm. 


Require: A FIC-AQP-NAM compressed image 
1: A FIC-AQP-NAM compressed file (J MGc) is taken. Set number of iteration (7, ) 
and scale factor (Sf) of image. 
2: Image size and domain density are read as size, x size, and DD from the input 
file respectively. 
3: The desired reconstructed image size dsize, x dsizey is calculated as- dsize; «— 
Sf x size, and dsizey «— Sf x sizex 
: Domain information is initialized that is similar with compression algorithm. 
: Take a black image (grey scale) of size dsize, x dsizey (say 1MGg). 
: Read all non-linear affine maps of / MGc. 
: While (7, > 0), do 
7.1: Apply all non-linear affine maps of /MGc over the image 7M Gg that 
produces a completely new image. 
7.2: Now, this produced image acts as 1M Gg. 
7.3: For each pixel value z; of the image /M Gg, if zi < —128, set z; < -128 and 
if z; > 127, set zi < 127. 
7.4: Set In «— I, — 1. 
End While; 
8: Smooth the transition between adjacent ranges of / MG a by pixel averaging. 
9: Output dsize, x dsizey IMGg as decompressed image. 
10: Stop. 
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6 The proposed variants 


The compressed image file / MG g of the proposed FIC-AQP-NAM technique keeps dif- 
ferent parameters of a number of non-linear affine transforms. All these transforms have 
a number of parameter like scaling factor c1, c2, brightness offset o, position of domain 
(21. 82) and rotation & flip operation types as shown in (3). Therefore, these parame- 
ters of the fractal compressed image can further be encoded to represent these in more 
compact forms in the compressed file by any loss-less technique without degradation of 
image quality. Hence, the size of the file may reduce and compression ratio may improve. 
Two variants of FIC-AQP-NAM have been suggested in this paper that use this concept. 
These variants apply optimality of LZW(OLZW) [27] and its modified version Modified 
OLZW (MOLZW) [28] that are effective variants of the dictionary based loss-less data com- 
pression technique LZW [46]. The proposed variants apply FIC-AQP-NAM with OLZW 
and MOLZW are termed as FIC-AQP-NAM-OLZW and FIC-AQP-NAM-MOLZW respec- 
tively. The encoding and decoding processes of FIC-AQP-NAM-OLZW are illustrated in 
Fig. 3a and b respectively. At the time of compression, it encodes the input image using 
proposed FIC-AQP-NAM compression process that produces a compressed file contain- 
ing number of affine transforms. The parameters of affine transforms are further encoded 
by using OLZW technique to produce final compressed image. During decompression, 
the compressed image is reconstructed by FIC-AQP-NAM-OLZW decoder. First, the com- 
pressed file is decompressed by OLZW decoder to obtain parameters of collection of affine 
transforms. Then, the file containing affine parameters is decompressed by FIC-AQP-NAM 
decompression process to reconstruct the final decoded image. 

The proposed variant FIC-AQP-NAM-MOLZW uses a different loss-less coding instead 
of OLZW that is known as MOLZW. The MOLZW is refined version of OLZW. The 
MOLZW encoding process is almost similar with OLZW except an additional checking to 
decide a dictionary is filled up or not before keeping a new phrase into the dictionary. If 
dictionary becomes filled up, least recently used phrase is eliminated to insert new phrase. 


7 Result and analysis 


All the experiments have been carried out on a machine with Intel i5 processor, DDR3 RAM 
(8 GB) and Ubuntu 14.04 OS. Five benchmark images (i.e. Lena, Pepper, Boats, Cameraman 
and Baboon) have been taken from an image database [45]. 

The results of the proposed FIC with AQP and non-linear affine maps (FIC-AQP-NAM) 
with its variants FIC-AQP-NAM-OLZW and FIC-AQP-NAM-MOLZW are presented 
against the existing FIC techniques that use Fisher’s classification with QP (FICQP-CC) 
[9] and AQP (AFIC-CC) [29], FIC with AQP and archetype classification (AFIC-AC) 
[30], FIC with QP and DWT (FICQP-DWT) [43], adaptive edge based FIC using FFT 
(AE-FIC-FFT) and RDCT (AE-FIC-RDCT) [12], fast FIC method based on distance group- 
ing (FFIC-DC)[22], FIC with AQP and hierarchical classification (AFIC-HC) [31] and 
it’s modified scheme (AFIC-MHC) [38] and FIC with QP and non-linear affine maps 
(FICQP-NAM) [50]. The compression ratios (25) of all these methods for five images 
with average (say AVG) (27) and standard deviation (say SD) (28) are kept in Table 1. 
The compression ratio of Lena offered by the proposed FIC-AQP-NAM is better than all 
other examined techniques. For other four images, the rate of compression of the pro- 
posed FIC-AQP-NAM is higher than FICQP-CC, AE-FIC-FFT, AE-FIC-RDCT, FFIC-DC 
and FICQP-NAM techniques. As a result, the proposed FIC-AQP-NAM improves average 


a Springer 


Multimedia Tools and Applications (2020) 79:26345-26368 26357 


Fractal 
Input image dd compressed OLZW nee 
Compression image Compression image 
(a) 
Fractal 
C d " S 
TISSUE OLZW Compressed FIC-AQP-NAM Recostructed 
image Decompression image Decompression image 
(b) 


Fig.3 The FIC-AQP-NAM-MOLZW technique a Compression process b Decompression process 


compression ratio than FICQP-CC, AE-FIC-DWT, AE-FIC-FFT, AE-FIC-RDCT, FFIC- 
DC and FICQP-NAM techniques. The average space saving in % (26) of all the examined 
techniques are also shown in Fig. 4. For all five images, the the compression ratio of 
proposed variants FIC-AQP-NAM-OLZW and FIC-AQP-NAM-MOLZW are significantly 
better than other methods. The proposed variants FIC-AQP-NAM-OLZW and FIC-AQP- 
NAM-MOLZW yield 2.43% and 2.60 % increment of avg. compression ratio w.r.t. the base 
method FICQP-CC and 3.45% and 3.61% increment w.r.t. FICQP-NAM respectively. These 
improvements of compression ratio are achieved by encoding parameters of affine maps. 
As a result, the average space saving in % also increased of the variants. 
Size of Compressed file in bit 


C j tio = b, 25 
WU ee Size of Original file in byte dd (25) 


Size of Compressed file 
Size of Original file 


Space saving = (1 ) x 100% (26) 


Table 1 Compression ratio in bpp with average and standard deviation (DD=1, QLTY=1 and MIN=2 x 2 


Compression technique Lena Pepper Boats Cameraman Baboon Avg Std Dev 
FICQP-CC [9] 1.360 1.026 1.119 1.278 1.383 1.233 0.155 
AFIC-CC [29] 1.337 1.003 1.094 1.242 1.354 1.206 — 0.153 
AFIC-AC [30] 1.338 1.003 1.098 1.241 1.363 1.207 . 0.153 
FICQP-DWT[43] 1.342 1.005 1.122 1.254 1.366 1.218 0.153 
AE-FIC-FFT [12] 1.375 1.031 1.124 1.279 1.398 1.241 0.160 
AE-FIC-RDCT [12] 1.381 1.040 1.245 1.291 1.402 1.272 0.145 
FFIC-DC [22] 1.348 1.030 1.105 1.242 1.356 1.216 0.145 
AFIC-HC [31] 1.337 1.003 1.094 1.242 1.354 1.206 0.153 
AFIC-MHC [38] 1.337 1.003 1.094 1.242 1.354 1.206 | 0.153 
FICQP-NAM [50] 1.390 1.034 1.122 1.295 1.391 1.246 | 0.162 
FIC-AQP-NAM 1.324 1.011 1.098 1.249 1.363 1.213 0.154 
FIC-AQP-NAM-OLZW 1.330 1.002 1.093 1.240 1.352 1.203 0.152 
FIC-AQP-NAM-MOLZW 1.324 1.002 1.091 1.238 1.350 1.201 0.150 
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Fig.4 The graphical representation of average percentage of space saving of all examined techniques 


1 n 
Average(x) = — X5 Q7) 
abus 
1 n 
Standard deviation = | — bol (x; — x) (28) 
n 


During decompression process of the proposed technique, a gray scale black image is 
taken as the initial image where gray values of image are close to zero. The process con- 
verses within a finite number of iterations and reconstructs the image. The PSNRs [13, 40] 
of decoded images with AVG and SD of all experimented techniques are given in Table 2 
where the PSNR is calculated by (29). Here, the RMS error between two images f and g as 
defined in (30) for image size M x N. 


GN 
PSNR —20log,5 5 dB (29) 
1 M N 
m Bee ue 
RMS= vx 2,2, Fi gij) (30) 
1=0 J= 


The significant improvements of decoded image quality of all five images are noticed 
of the proposed methods. The proposed FIC-AQP-NAM and its variants improve 6.82 % 
avg. PSNR w.r.t. the base method FICQP-CC and 0.85% w.r.t. FICQP-NAM respectively. 
The PSNRs of proposed variants FIC-AQP-NAM-OLZW and FIC-AQP-NAM-MOLZW 
are same with FIC-AQP-NAM and there are no degradations of the PSNR for increasing 
compression ratios. The reconstructed Lena images after 2nd qth 6th and 8t” iterations 
of the proposed FIC-AQP-NAM are illustrated in Fig. 5a, b, c and d respectively where 
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Table2 PSNR in dB with average and standard deviation (DD=1, QLTY=1 and MIN=2 x 2 


Compression technique Lena Pepper Boats Cameraman Baboon Avg Std Dev 
FICQP-CC [9] 28.90 29.83 25.30 27.29 20.11 26.286 | 3.857 
AFIC-CC [29] 29.31 . 30.06 26.42 27.83 21.58 27.040 | 3.358 
AFIC-AC [30] 29.36 | 30.09 26.48 27.85 21.59 27.004 . 3.367 
FICQP-DWT [43] 28.86 29.81 2526 27.27 20.10 26.260 | 3.851 
AE-FIC-FFT [12] 29.20 29.85 2623 27.477 21.35 26.820 3.374 
AE-FIC-RDCT [12] 29.23 30.04 26.20 27.55 21.42 26.888 3.400 
FFIC-DC [22] 29.35 30.08 26.52 27.87 21.58 27.080 | 3.367 
AFIC-HC [31] 29.3] | 30.06 26.42 27.83 21.58 27.040 | 3.358 
AFIC-MHC [38] 29.31 . 30.06 26.42 27.83 21.58 27.040 | 3.358 
FICQP-NAM [50] 31.700 31.82 26.45 27.86 21.39 27.844 4.309 
FIC-AQP-NAM 31.78 32.11 26.68 27.97 21.86 28.080 4.201 
FIC-AQP-NAM-OLZW 31.78 32.11 26.68 27.97 21.86 28.080 4.201 
FIC-AQP-NAM-MOLZW 31.78 32.11 26.68 27.97 21.86 28.080 4.201 


(c) (d) 


Fig.5 Reconstructed images after (a) 2”, (b) 4", (c) 6", (d) 8" iterations using proposed FIC-AQP-NAM 
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image becomes more close with original image after each iteration. The original benchmark 
images, reconstructed images using FICQP-CC, FICQP-NAM and proposed FIC-AQP- 
NAM/ FIC-AQP-NAM-OLZW/ FIC-AQP-NAM-MOLZW are illustrated in Fig. 6a, b, c 
and d respectively. Another image quality measurement metric i.e. Structural Similarity 
Index Measure (SSIM) [13, 41] of these reconstructed images are also measured to com- 
pare image quality of proposed methods with FICQP-CC and FICQP-NAM where it lies 
between 0 and 1 and higher value means better image quality. The SSIM values of decoded 
five images for FICQP-CC, FICQP-NAM and proposed FIC-AQP-NAM techniques are 
mentioned in the Fig. 6. The SSIM values of decoded Lena image for FICQP-CC, FICQP- 
NAM and proposed techniques are 0.7725, 0.8520 and 0.8645 respectively. The same for 
Pepper image are 0.7958, 0.8555 and 0.8627 respectively. The decoded Boats image yields 
0.6825, 0.7212 and 0.7270 and Cameraman image yields 0.7322, 0.7565 and 0.7592 for 
FICQP-CC, FICQP-NAM and proposed methods. The SSIM values of decoded Baboon 
image for FICQP-CC, FICQP-NAM and proposed methods are 0.5525, 0.5847 and 0.5965 
respectively. Hence, the image qualities of the proposed techniques in terms of SSIM are 
significantly better than its counterparts. The distance between histogram of original and 
reconstructed image using intersection [25], correlation [37], x? -test [48], Kullback-Leibler 
distance [17] and Bhattacharyya distance[5] metrics are given in Table 3. For higher val- 
ues of intersection and correlation, better matching of original and reconstructed images are 
found. However, the lower values of other metrics indicate better matching of these images. 
If the contractive conditions of affine maps are not restricted, the decoding process does not 
converge. Fig. 7a is the decoded Lena image after 8’” iterations without restriction of con- 
tractive conditions and it is totally not recognizable. This result shows the importance of 
contractive condition. The decoded Lena images without adjusting the gray values of image 
are shown in Fig. 7b after 8” iteration where decoding starts with a 256 x 256 black gray 
scale image. Here also, the decoding process does not converse within a finite number of 
iterations. The reconstructed images have a large numbers of blocky portions. Therefore, 
the gray value adjustment is another important requirement. 

Table 4 contains the time of encoding in second with AVG and SD of all these methods. 
It is observed that the avg. encoding time of the proposed FIC-AQP-NAM is lower than 
AFIC-CC and AFIC-AC but other examined techniques. Because,the compression pro- 
cess takes more time to find optimum parameters of non-linear affine maps. The adaptive 
quadtree partitioning also makes the compression slow where partitioning points are deter- 
mined based on image context.The two variants become slightly slow than FIC-AQP-NAM 
also since these two applied OLZW or MOLZW after FIC. The decompression times of 
all the methods examined with AVG and SD are given in Table 5. It is noticed that the 
decompression times of these methods are low than corresponding compression times since 
the decompression process iterates only affine transforms on an image to reconstruct the 
decoded image. However, the decompression times of proposed methods are greater than 
other examined methods since it uses non-linear affine map. Both the proposed variants 
have more decoding time for additional OLZW/MOLZW decoding step. 

Figure 8 show how the avg. quality (i.e. avg. PSNRs) of five images vary with avg. com- 
pression ratio for FICQP-CC, FICQP-NAM, proposed FIC-AQP-NAM and its two variants. 
The avg. PSNR values are increased with the increasing avg. compression ratio of all five 
techniques since better PSNR can be obtained if the compressed image keeps more affine 
transforms. As a result, the size of the compressed image becomes larger offering high com- 
pression ratio. It is also noticed that all three proposed techniques offer higher avg. PSNRs 
with respected to avg. compression ratio than its counter parts and FIC-AQP-NAM is better 
among those. Figure 9a and b depict how the qualities (i.e. PSNRs) of Lena image vary with 
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Original image FICQP-CC FICQP-NAM FIC-AQP-NAM 


PSNR: 31.70 dB, SSIM: 0.8520 


(c) (d) 


PSNR: 25.30 dB, SSIM: 0.6825 PSNR: 26.45 dB, SSIM: 0.7212 


(b) (c) 
256:256 Boats image 


A. E! ; : 
PSNR: 27.29 dB, SSIM: 0.7322 PSNR: 27.86 dB, SSIM: 0.7565 


(a) (b) (c) (d) 


256x256 Cameraman image 


255] 


(a) (b) (c) (d) 
256x256 Baboon image 


Fig.6 Images a Original and reconstructed using techniques b FICQP-CC c FICQP-NAM d proposed FIC- 
AQP-NAM and its variants 
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Table3 The comparison of histogram between original and recontrscted image of the proposed FIC-AQP- 


NAM technique 

Metric Lena Pepper Boats Cameraman Baboon 
Intersection [25] 102.26 98.53 95.30 33.94 86.42 
Correlation [37] 0.992 0.974 0.942 0.967 0.873 
x2-test [48] 0.382 0.610 2.482 4.952 2.540 
Kullback-Leibler distance [17] 3.066 6.010 5.981 9.587 12.127 
Bhattacharyya distance [5] 0.022 0.020 0.263 0.049 0.240 


Fig.7 The decoded Lena image after 8^ iteration a without restriction of contractive condition b without 


gray value adjustments 


Table4 Compression time in second with average and standard deviation (DD=1, QLTY=1 and MIN=2 x 2) 


Compression technique 


FICQP-CC [9] 
AFIC-CC [29] 
AFIC-AC [30] 
FICQP-DWT [43] 
AE-FIC-FFT [12] 
AE-FIC-RDCT [12] 
FFIC-DC [22] 
AFIC-HC [31] 
AFIC-MHC [38] 
FICQP-NAM [50] 
FIC-AQP-NAM 
FIC-AQP-NAM-OLZW 
FIC-AQP-NAM-MOLZW 


Lena 


0.22 
0.36 
0.34 
0.17 
0.21 
0.20 
0.19 
0.16 
0.16 
0.31 
0.34 
0.36 
0.37 


Pepper 


0.23 
0.34 
0.33 
0.15 
0.21 
0.21 
0.21 
0.14 
0.14 
0.32 
0.31 
0.34 
0.34 


Boats 


0.20 
0.38 
0.35 
0.16 
0.18 
0.18 
0.18 
0.15 
0.15 
0.30 
0.35 
0.38 
0.39 


Cameraman 


0.28 
0.46 
0.44 
0.19 
0.25 
0.24 
0.24 
0.17 
0.16 
0.39 
0.41 
0.47 
0.47 


Baboon 


0.23 
0.33 
0.32 
0.20 
0.20 
0.20 
0.20 
0.16 
0.15 
0.31 
0.32 
0.34 
0.35 


Avg 


0.232 
0.374 
0.356 
0.174 
0.210 
0.206 
0.204 
0.156 
0.152 
0.326 
0.346 
0.378 
0.384 


Std Dev 


0.029 
0.052 
0.048 
0.021 
0.025 
0.022 
0.023 
0.011 
0.008 
0.036 
0.039 
0.054 
0.052 
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Table 5 Decompression time in second with average and standard deviation (DD-1, QLTY=1 and 


MIN=2 x 2) 


Compression technique 


FICQP-CC [9] 
AFIC-CC [29] 
AFIC-AC [30] 
FICQP-DWT [43] 
AE-FIC-FFT [12] 
AE-FIC-RDCT [12] 
FFIC-DC [22] 
AFIC-HC [31] 
AFIC-MHC [38] 
FICQP-NAM [50] 
FIC-AQP-NAM 
FIC-AQP-NAM-OLZW 
FIC-AQP-NAM-MOLZW 


Lena 


0.024 
0.032 
0.037 
0.034 
0.025 
0.025 
0.02 

0.023 
0.025 
0.025 
0.034 
0.036 
0.037 


Pepper 


0.023 
0.031 
0.032 
0.033 
0.023 
0.018 
0.015 
0.019 
0.021 
0.025 
0.032 
0.037 
0.037 


Boats Cameraman Baboon 


0.024 0.027 0.023 
0.040 0.042 0.031 
0.044 0.041 0.032 
0.041 0.042 0.032 
0.025 0.028 0.024 
0.019 0.021 0.022 
0.018 0.017 0.016 
0.018 0.023 0.026 
0.024 0.022 0.024 
0.024 0.028 0.023 
0.041 0.042 0.032 
0.043 0.043 0.034 
0.044 0.043 0.035 


Avg 


0.024 
0.035 
0.037 
0.036 
0.025 
0.021 
0.017 
0.022 
0.023 
0.025 
0.036 
0.039 
0.039 


Std Dev 


0.002 
0.005 
0.005 
0.005 
0.002 
0.003 
0.002 
0.003 
0.002 
0.002 
0.005 
0.004 
0.004 


time of compression and decompression respectively. The improvements of PSNR values 
are noticed with the increasing of both compression and decompression time of all five tech- 
niques since more time is required to compress and decompress images with large number 
of affine transforms for better PSNRs. The variations of compression times and compression 
ratios for Lena image with increasing mean square error (MSE) are illustrated in Fig. 10a 
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Fig.8 The variation of avg. PSNR (in dB) with increasing avg. compression ratio (in bpp) 
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Fig.9 a The variation of PSNR (in dB) with increasing compression time (in second) for Lena image b The 
variation of PSNR (in dB) with increasing decompression time (in second) for Lena image 


and b respectively of the same five techniques. It is observed that the compression times 
of these techniques decrease slowly and compression ratio increases significantly with the 
increasing MSE. Low variation of compression time indicating these techniques execute 
properly for any image quality and higher MSE yields poor quality reconstructed image to 
lead high ratio of compression. Figure 11a shows the plots of compression time of Lena 
image with DD of FICQP-CC, FICQP-NAM, proposed FIC-AQP-NAM and its two vari- 
ants. It is observed that the compression times of these techniques drop with higher domain 
density since number of domain searching reduces for higher domain density. The variation 
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Fig. 10 a The variation of compression time (in second) with increasing MSE threshold for Lena image b 
The variation of compression ratio (in bpp) with increasing MSE threshold for Lena image 
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Fig. 11 a The variation of compression time (in second) with increasing domain density for Lena image b 
The variation of compression ratio (in bpp) with increasing domain density for Lena image 


of compression ratio of Lena image with domain density is shown in Fig. 11b where a very 
low variation in compression ratios of these techniques are noticed for increasing domain 
density. It is observed from Fig. 12a and b that the decompression times of these techniques 
decrease with the increasing MSE but no significant variation for DD. Figure 13a and b rep- 
resent the plots for variation of PSNR and SSIM with MSE respectively where both PSNR 
and SSIM decrease with increasing MSE of the same five techniques. Because, increasing 
MSE decreases image quality. 
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8 Conclusion 


The proposed technique greatly improves the decoded image quality than its counterparts by 
using non-linear affine maps to produce better pixel intensity approximations and adaptive 
quadtree partitioning scheme to split range block in such a way that it enhance the possibil- 
ity of finding self-matching portions. The technique also offers better or at least almost close 
compression rate compare with existing techniques. Two variants further improve compres- 
sion ratio significantly using loss-less coding keeping image quality unchanged. However, 
the requirement of gray values adjustment after end of each an iteration to converse decom- 
pression process is extra overhead of the proposed technique. Further investigation should 
be continued to overcome this limitation. 
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